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FINGERPRINT MINUTIAE MATCHING USING SCORING TECHNIQUES 

Field 

[0001] Embodiments of the invention relate generally to classification and feature extraction, 
and more particularly, to fingerprint minutiae matching using scoring techniques. 

Description of Related Art 

[0002] Feature extraction is a current area of research and development in digital image 
processing and computer vision, particularly in areas relating to feature-based pattern 
recognition. For example, many image recognition, image detection, and biometric 
applications have been previously developed based on various techniques for feature 
extraction and pattern recognition. 

[0003] Feature extraction in fingerprint images has unique aspects compared to general- 
purpose image processing applications, at least in part due to its special topological 
characteristics. In particular, in a fingerprint image, there are certain curved contours called 
ridgelines. The ridgelines correspond to minute elevations on the skin of the finger. They 
either end abruptly or split into two other ridges. These points at which ridges end or split are 
unique characteristics of a fingerprint and are called "minutiae" or "Galton characteristics" 
according to its observer, Sir Francis Galton. Galton calculated that the probability of an 
exact resemblance of any two fingerprints with each other is as low as one in sixty-four 
billion. 

[0004] Automatic Fingerprint Identification Systems (AFISs) are typically based on minutiae 
matching. Minutiae are the terminations and bifurcations of the ridgelines in a fingerprint 
image. Most of the prior approaches utilized in feature extraction of fingerprint images 
transform a fingerprint image (e.g. a gray-scale image) into a binary image based at least in 
part on the convolution of the image with a filter coupled with certain variants of 
thresholding. However, these approaches have several disadvantages, such as computational 
intensity and the inability to robustly address noisy images. Particularly, noise and contrast 
deficiency, caused by non-ideal conditions, such as, ink excessiveness or ink deficiency, can 
introduce false minutiae and/or hide valid minutiae. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
[0005] Figure 1 is a flow diagram illustrating a process to implement fingerprint minutiae 
matching using scoring techniques, according to one embodiment of the present invention. 
[0006] Figure 2 is a flow diagram illustrating a broad overview of a process to estimate a 
score for a fingerprint minutiae point corresponding to the validity of the minutia, according 
to one embodiment of the present invention. 

[0007] Figure 3 is a simplified representation of a section of a fingerprint image showing 
ridges and valleys to aid in illustrating the process of estimating a score for a bifurcation 
minutia, according to one embodiment of the present invention. 

[0008] Figure 4 is a simplified representation of a section of a fingerprint image showing 
ridges and valleys to aid in illustrating the process of estimating a score for a termination 
minutia, according to one embodiment of the present invention. 

[0009] Figure 5 is an exemplary gray-scale fingerprint image to which embodiments of the 
invention for fingerprint minutiae matching using scoring techniques is applied, for 
explanatory purposes. 

[0010] Figure 6 is an example of a fingerprint image that has undergone pre-processing and 
that has had minutiae removed that do not belong to the classes of bifurcation or termination. 
[0011] Figure 7 is a table illustrating coordinates, classifications, angles, and scores of a 
reduced set of minutiae. 

[0012] Figure 8 is an example of a fingerprint image that has undergone scoring, in which 
only minutiae with a score greater than or equal to 1 are shown. 

[0013] Figure 9 is an example of a fingerprint image that has undergone scoring, in which 
only 10 bifurcation minutiae and 5 termination minutiae with the highest scores are shown. 
[0014] Figure 10 is an example of a fingerprint image that has undergone scoring, in which 
only 5 bifurcation minutiae and 2 termination minutiae with the highest scores are shown. 
[0015] Figure 1 1 is a table illustrating the experimental performance of a standard matching 
algorithm versus the partial point set pattern matching (PSPM) algorithm utilizing reduced 
scored minutiae, according to embodiments of the present invention. 
[0016] Figure 12 is an example of a primary structure and a secondary structure. 
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DETAILED DESCRIPTION 
[0017] In the following description, the various embodiments of the invention will be 
described in detail. However, such details are included to facilitate understanding of the 
invention and to describe exemplary embodiments for employing the invention. Such details 
should not be used to limit the invention to the particular embodiments described because 
other variations and embodiments are possible while staying within the scope of the 
invention. Furthermore, although numerous details are set forth in order to provide a 
thorough understanding of the embodiments of the invention, it will be apparent to one 
skilled in the art that these specific details are not required in order to practice the 
embodiments of the invention. In other instances details such as, well-known methods, types 
of data, protocols, procedures, components, electrical structures and circuits, are not 
described in detail, or are shown in block diagram form, in order not to obscure the invention. 
Furthermore, embodiments of the invention will be described in particular embodiments but 
may be implemented in hardware, software, firmware, middleware, or a combination thereof. 
[0018] In a fingerprint image, there are certain curved contours, referred to in this context as 
ridgelines. The ridgelines correspond to minute elevations on the skin of the finger. They 
either end abruptly or split into two or more ridges. The points at which ridges end or split are 
unique characteristics of a fingerprint and are called "minutiae" or "Galton characteristics", as 
previously discussed. 

[0019] As is well known, by correlating minutiae sets, an expert or computer system may 
match fingerprints. Several Automatic Fingerprint Identification Systems (AFISs) utilize 
minutiae matching techniques. See, for example, J. Hollingum, Automated Fingerprint 
Analysis Offers Fast Verification, Sensor Review, vol. 12, no. 13, pp. 12-15, 1992; B. M. 
Mehtre and N. N. Murthy, A Minutiae Based Fingerprint Identification System, in 
Proceedings Second International Conference on Advances in Pattern Recognition and 
Digital Techniques, Calcutta 1986; F. Pernus, S. Kovacic and L. Gyergyek, Minutiae-Based 
Fingerprint Recognition, in Proceedings Fifth International Conference on Pattern 
Recognition, pp. 1380-1382, 1980; J. H. Wegstein, An Automated Fingerprint Identification 
System, U.S. Government Publication, Washington, 1982. As proposed by the American 
National Standards Institute, see, for example, American National Standards Institute, 
Fingerprint Identification-Data Format for Information Interchange, New York, 1986, a 
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minutiae may be classified into the following four classes depending at least in part on its 
location in the ridge topology: Termination, Bifurcation, Crossover, and Undetermined. 
[0020] The model followed by the Federal Bureau of Investigation (FBI), see, for example, J. 
H. Wegstein, An Automated Fingerprint Identification System, U.S. Government Publication, 
Washington, 1982, adopted in most AFIS, is based on a two-class minutiae classification: 
termination and bifurcation. The embodiments described in more detail hereinafter apply the 
two-class model used by FBI, although, of course the claimed subject matter is not limited in 
scope in this respect. These embodiments are provided here merely as example applications. 
[0021] An issue in automatic minutiae detection processes arises when the quality of a 
fingerprint image (e.g. a gray-scale image) is degraded. Noise and contrast deficiencies, 
attributable to non-ideal conditions, such as, ink excessiveness or ink deficiency, for example, 
may introduce false minutiae and/or hide valid minutiae, reducing the quality of the overall 
results of the process, as well as the speed of the process. Embodiments of the invention 
related to fingerprint minutiae matching using scoring techniques described hereinafter 
addresses such issues 

[0022] As has been described, automatic minutiae detection from gray-scale images and fast 
minutiae matching is a challenging task. Embodiments of the invention relate to a fast 
algorithm for partial point set pattern matching (PSPM) and its application to fingerprint 
minutiae matching. Not all minutiae in a fingerprint are of equal importance. Therefore, in 
order to characterize minutiae of higher significance, a method to assign scores (weights) to 
each minutia is provided. A minutia of higher significance correspondingly is assigned a 
higher score. Thereafter, a PSPM algorithm is used to find a weighted matching between, for 
example, a scored query fingerprint image and one or more scored sample fingerprint images. 
[0023] Embodiments of the invention utilize the two-class model used by the FBI as a 
baseline. Further, for each minutiae, its membership class and corresponding co-ordinates 
with angles and scores is determined and stored in a fingerprint database. As is known, 
typically minutiae detection and matching becomes extremely difficult when the quality of a 
fingerprint image is poor. Particularly, noise and contrast deficiency, caused by non-ideal 
conditions, such as, ink excessiveness or ink deficiency, can introduce false minutiae and/or 
hide valid minutiae. However, false and/or hidden minutiae arising from noise is taken into 
account by a score value utilized in embodiments of the invention. For example, minutiae in 
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a noisy zone of a fingerprint image are assigned lower scores compared to others. Thus, 
minutiae with higher scores are of more importance for matching. 

[0024] Embodiments of the invention relate to a technique to assign scores to the minutiae 
extracted from a gray-scale fingerprint image. Further, a fast algorithm for partial point set 
pattern matching (PSPM) is disclosed. This technique for weighted minutiae comparison 
gives a better and more accurate matching of fingerprints. 

[0025] Thus, embodiments of the present invention relate to fingerprint minutiae matching. 
Particularly, embodiments of the present invention relate to defining a plurality of minutiae in 
a fingerprint image and estimating and associating a score with each minutia corresponding 
to the validity of each minutia. The fingerprint image is then matched against one or more 
sample fingerprint images utilizing a partial point set pattern matching (PSPM) algorithm. 
[0026] Turning now to Figure 1, Figure 1 is a flow diagram illustrating a process 1 10 to 
implement fingerprint minutiae matching using scoring techniques, according to one 
embodiment of the present invention. Process 1 10 broadly covers the operations performed 
to implement fingerprint minutiae matching. At block 120, a plurality of minutiae in a 
fingerprint image are defined. In one embodiment, the fingerprint image may be taken from 
a gray-scale fingerprint image. Next, a score for each minutia corresponding to the validity 
of each minutia is estimated and assigned to its respective minutia (block 130). After this, a 
matching procedure is performed utilizing a partial point set pattern matching (PSPM) 
algorithm. In this way, a scored fingerprint image and one or more scored sample fingerprint 
images can be compared and matched using the PSPM algorithm in an accurate and efficient 
process. The matching procedure utilizing the PSPM algorithm will be discussed in more 
detail below. 

[0027] With reference now to Figure 2, Figure 2 is a flow diagram illustrating a broad 
overview of a process 200 to estimate a score for a fingerprint minutia corresponding to the 
validity of the minutia, according to one embodiment of the present invention. Briefly, at 
block 210, a score for ridge flow properties for the minutia being considered is estimated. 
The score for the ridge flow properties corresponds to the smoothness of the ridgelines about 
the minutia. Next, a score for valley flow properties for the minutia being considered is 
estimated (block 220). The score for the valley flow properties corresponds to the 
smoothness of the valley lines about the minutia. Then, a score due to noise associated with 
the minutia being considered is estimated (block 230). The score due to noise corresponds to 
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the amount of noise about a minutia in a pre-determined window about the minutia. Lastly, 
the process 200 sums the ridge score, the valley score, and the noise score for the minutia 
under consideration to determine a total score for the minutia (block 240). Each of these 
operations will be discussed in greater detail below. 

[0028] A fingerprint image essentially consists of a set of minutiae on an x-y plane. In one 
embodiment of the present invention, a minutia P can be defined as a 5-tuple, P= <x f y, t, 0, 
s>, where, (x,y) = co-ordinates of P 9 1 = type of minutiae (a bifurcation minutiae or a 
termination minutiae), 0 = angle made by the tangent to the corresponding ridge at the point 
(x,y) 9 and, s = score associated with the minutiae P. The model followed by the Federal 
Bureau of Investigation (FBI) (J. H. Wegstein, An Automated Fingerprint Identification 
System, US Government Publication, Washington, 1982), adopted in most AFIS, is based on 
a two-class minutiae classification: termination and bifurcation. In one embodiment of the 
present invention, the two-class model used by FBI, is utilized. 

[0029] Particularly, for each minutia P 9 a score value s along with its membership class t, 
angle 0and corresponding co-ordinates are determined and stored. The score of a minutia 
indicates the level of authenticity of the minutia in the corresponding fingerprint image. A 
score for a minutia lies between 0 and 100, where a minutia with a score nearing 100 is of 
paramount significance compared to any other minutia with a lower score value. In other 
words, if a minutiae Pj has a score sj and another minutia P 2 has a score S2 9 where sj < S2, 
then Pj is a less dependable minutiae than P2. 

[0030] 9 is defined as the angle at the minutia P made by the tangent to the corresponding 
ridgelines with respect to the positive x-axis and let X be defined as the average inter-ridge 
distance of the corresponding fingerprint image. Below is an example of an algorithm, 
according to one embodiment of the invention, that may be utilized to determine an angle 0: 

if (P = "BM") /* bifurcation minutiae */ 

detect the three ridges incident at P and name them as a 9 b 9 c; 
traverse along a 9 b 9 c separately starting from P by lengths of l a , l b9 l c 
to reach Q a9 Q b9 Q c \ 

if (l a (or l b or l c ) encounters any bifurcation or termination), or, 
if (l a (or l b or l c ) = A), 
traversal stops; 
if (more than one among l Q9 l b , l c are less than AJ2) 9 
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P is not a minutiae; 

else 

evaluate and compare the three straight line distances Q a Qb, QbQc, QcQa\ 

w.l.g., consider that QbQc is minimum; 

if(G*0c>3A/2) 

P is not a minutiae; 

else 

rename a, b, c as r, r/, r 2 ; /* r is pre-bifurcated ridge */ 
rename / fl , fe, / c as /, //, / 2 ; rename 0 a , Q b , Q c as 0, g/, Q 2 \ 
I* Q lies on r and ridge segment length from PtoQ = l*/ 
evaluate 9 = angle of minutiae P = 

angle made by tangent to r at P w.r.t. (+) x-axis; 

return 9 ; 

else 

if (P = "TM") /* termination minutiae */ 
detect the ridge r incident at P\ 
traverse along r starting from P by a length of X\ 
evaluate 9 = angle of minutiae P = 

angle made by tangent to r at P w.r.t. (+)x-axis; 

return 9 ; 

[0031] The score s of a minutia P may be estimated based on the following properties: 1) 
pattern of ridge flow in and around P\ 2) pattern of valley flow in and around P\ and 3) noise 
level in the locality of P. 

[0032] With reference now to Figure 3, an example of the determination of a minutiae score 
for a bifurcation minutia will now be presented. Figure 3 is a simplified representation of a 
section of a fingerprint image showing ridges and valleys to aid in illustrating the process of 
estimating a score for a bifurcation minutia, according to one embodiment of the present 
invention. 

[0033] It should be noted that if the ridgelines and valley lines in the local neighborhood of P 
have a smooth nature of flow, the corresponding minutia P will have a genuine contribution 
in the fingerprint matching and will have a high score. On the contrary, if in some region, the 
ridge and valley lines have a erratic or uneven nature of flow, any minutia P ' in that region 
should not predominate the matching procedure of two fingerprint images and will 
correspondingly have a low score. The former minutia (P), being located in a tidy region, is 
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more capable to participate in the matching procedure than the latter (P'), which is located in 
a clumsy and noisy region. 

[0034] An illustrative example with reference to Figure 3, will now be presented. Let P be a 
bifurcation minutia and its score, s = s r + s v - s n , where, s r = score due to ridge flow 
properties, s v = score due to valley flow properties and s n = negative score due to noise 
prevailing in the local region of P. 

[0035] Let r be the ridge before bifurcation on which P lies and r ly r 2 are the bifurcated 
ridges originated from P. Let n\ and n 2 be the neighbor ridges of rj and r 2 respectively. Let 
P' be the termination minutiae of the valley line v which flows between the bifurcated 
ridgelines r/ and r 2 . Let v/ be the valley line running between r and «/, and v 2 the valley line 
between r and n 2 . 

[0036] Particularly, it can be seen that the points Q, Qj and Q 2 on the ridgelines r, r } and r 2i 
respectively, are each located at a distance of X (average inter-ridge distance of the 
corresponding fingerprint image) from P, measured along the corresponding ridgelines. In 
order to acquire these three points, the three ridges r, r 7 and r 2 are each traversed separately, 
starting from P. While traversing, if any branching from or termination of the respective 
ridge occurs, the traversal of the ridge is stopped and the process returns from that point 
along the corresponding ridge length traversed so far. Therefore, if any two of the three 
ridges has a traversed length < /1/2, the score of P is assigned as zero since the ridge flows are 
susceptible to abnormality. 

[0037] If the distance between P and P ' is less than A, we find a point P " on v such that PP ' 
+ ridge segment length P'P" = k is found; otherwise, P" is considered to be coinciding with 

P\ 

[0038] After getting the four control points Q, Q h Q 2 and P '\ the corresponding tangents to 
the respective ridge/valley lines r, r/, r 2 and v are evaluated, and the process finds the angles 
made by these tangents with (+) x-axis, namely, a r , a/, a 2 , a v respectively. The angles a n 
a h a 2 , a v are used to find the normals to corresponding ridge/ valley lines and the angles 
made by these normals on (+) x-axis, namely, <t> 2 , The angles <j> n <f>u fa, c/h lies in 
the range of (0°, 360°) and serves as the guiding directions to locate the nearest points of the 
neighboring ridge/ valley lines in the subsequent steps of finding the scores of P as shown in 
the algorithm below. 
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[0039] Below is an exemplary algorithm to find a score of a bifurcation minutia P, according 
to one embodiment of the present invention: 



initialize: s r = 0,s v = 0, s n = 0; 



detect the three ridges incident at P and name them as r, r h r 2 , 
where, r is the pre-bifurcated ridge and 
ry, r 2 are the two bifurcated ridges from r; 

traverse along r, ry, r 2 separately starting from P by lengths of/, //, l 2 
to reach Q, Q h Q 2 \ 

if ((/ (or 1 1 or l 2 ) encounters any bifurcation or termination), or, 
(I (or I j or/ 2 ) = A)), 
traversal stops; 
search for a valley termination P ' guided by the direction 6 

lying in between the bifurcated ridges ry and r 2 \ 
if (straight line distance between P and P ' = X) 
make />" = />'; 

else 

traverse along v starting from P' by a length of V 
to reach P " such that PP' + 1' = ?l\ 



evaluate a r = angle made by tangent to r at Q with respect to (w.r.t.) (+) x-axis; 

evaluate aj = angle made by tangent to rj at Qi w.r.t. (+) x-axis; 

evaluate a 2 = angle made by tangent to r 2 at Q 2 w.r.t. (+) x-axis; 

evaluate a v = angle made by tangent to v at P" w.r.t. (+) x-axis; 

evaluate <j) r = angle made by normal to r at Q w.r.t. (+) x-axis; 

evaluate <f>i = angle made by normal to r/ at Qi w.r.t. (+) x-axis; 

evaluate <j) 2 = angle made by normal to r 2 at Q 2 w.r.t. (+) x-axis; 

evaluate (f> v = angle made by normal to v at P" w.r.t. (+) x-axis; 



evaluate QKj = perpendicular distance of n/ from Q with the guidance of <f> r ; 
evaluate QK 2 = perpendicular distance of n 2 from g with the guidance of <j> r \ 
evaluate QLj = perpendicular distance of vy from Q with the guidance of <t> r \ 
evaluate QL 2 = perpendicular distance of v 2 from Q with the guidance of $•; 
evaluate QjMj = perpendicular distance of tij from Qj with the guidance of (j>i\ 
evaluate Q/Uj = perpendicular distance of vy from Qj with the guidance of $i\ 
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evaluate Q2M2 = perpendicular distance of ti2 from Q 2 with the guidance of fa, 
evaluate Q2U2 - perpendicular distance of v 2 from Q 2 with the guidance of fa 
evaluate P"Nj = perpendicular distance of n } from P" with the guidance of fa, 
evaluate P "Vi = perpendicular distance of vy from P" with the guidance of fa, 
evaluate P"Rj = perpendicular distance of ry from?" with the guidance of fa, 
evaluate P"N 2 = perpendicular distance of ti2 from P" with the guidance of fa, 
evaluate P t 'V 2 - perpendicular distance of V2 from P" with the guidance of fa, 
evaluate P"R2 = perpendicular distance of r 2 from P" with the guidance of fa 



compare QKj w.r.t. A; update s r ; 
compare QK 2 w.r.t. A; update s r \ 
compare QLj w.r.t. A/2; update s v ; 
compare QL2 w.r.t. AJ2; update s v \ 
compare QjMj w.r.t. X\ update s r \ 
compare QjUj w.r.t. XI2\ update s v \ 
compare Q2M2 w.r.t. X\ update s r \ 
compare Q 2 U 2 w.r.t. A/2; update 
compare P"Nj w.r.t. 3 A/2; update s r ; 
compare P"Vj w.r.t. A; update s v ; 
compare P"Rj w.r.t. A/2; update s r ; 
compare P"A^ w.r.t. 3 A/2; update s r ; 
compare P"V 2 w.r.t. A; update .y v ; 
compare P ,, R 2 w.r.t. A/2; update s r \ 

evaluate s n = score due to noise (if any) in the locality of P\ 

S Sf Sy ~ Sri, 

normalize s in [0,100] scale; 
return s; 

[0040] With reference now to Figure 4, an example of the determination of a minutiae score 
for a termination minutia will now be presented. Figure 4 is a simplified representation of a 
section of a fingerprint image showing ridges and valleys to aid in illustrating the process of 
estimating a score for a termination minutia, according to one embodiment of the present 
invention. 
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[0041] Let r be the ridge on which P lies and nl and n2 be the two neighbor ridges of r. Let 
P' be the bifurcation minutiae of the valley line v which flows between adjacent ridgelines nl 
and n2. Let vl and v2 be the two valley lines bifurcated from v and incident at P\ 
[0042] Particularly, it can be seen that point Q on the ridgeline r located at a distance of X 
from P can be measured along r. Note that such a point Q is always there in the skeletonized 
image for each termination minutia P; otherwise, r would have been eliminated as a spur in 
the pre-processing phase. If the straight distance between P and P' is less than X, a point P" 
can be found on v such that PP' + ridge segment length P'P" = X; otherwise, P" is considered 
to be coinciding with P\ 

[0043] Next, the corresponding tangents at Q and P" to the ridgelines r and valley line v are 
respectively evaluated to find the angles made by these tangents w.r.t. (+)x-axis, namely, ct r 
and a v , respectively. The angles a r and oc v are used to find the normals to corresponding 
ridge/valley lines and the angles (j) r and (j) v made by these normals w.r.t. (+)x-axis. The angles 
<j) r and <|>v lies in the range of (0 deg., 360 deg.) and serve as the guiding directions to locate 
the nearest points of the neighboring ridge/valley lines in the subsequent operations of 
finding the scores of P as shown in the algorithm below. 

[0044] Below is an exemplary algorithm to find a score of a termination minutia P, according 
to one embodiment of the present invention: 

initialize: s r =0, s v =0, s n = 0; 

traverse along r starting from P by a length of X to reach Q\ 

search for a valley bifurcation P 9 guided by the direction 6 

lying in between the neighbor ridges rtj and n?, 
if (straight line distance between P and P' = X) 

make = 

else 

traverse along v starting from P ' by a length / ' to reach P " such that PP >J rV = X\ 

evaluate a r = angle made by tangent to r at Q w.r.t. (+)x-axis; 
evaluate a v = angle made by tangent to v at P" w.r.t. (+)x-axis; 
evaluate (j> r = angle made by normal to r at Q w.r.t. (+)x-axis; 
evaluate (f) v = angle made by normal to v at P" w.r.t. (+)x-axis; 
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evaluate QK } = perpendicular distance of /*/ from Q with the guidance of <j) r ; 
evaluate QK 2 = perpendicular distance of n 2 from Q with the guidance of 
evaluate QLj = perpendicular distance of vy from Q with the guidance of 
evaluate QL 2 = perpendicular distance of v 2 from Q with the guidance of <j> r ; 
evaluate P"Nj = perpendicular distance of n } from P" with the guidance of (j) v ; 
evaluate P"N 2 - perpendicular distance of n 2 from P" with the guidance of <fi v ; 



compare QKj w.r.t. A; update s r ; 

compare QK 2 w.r.t. A; update s r ; 

compare QLj w.r.t. AJ2; update s v ; 

compare QL 2 w.r.t. AJ2\ update s v \ 

compare P"Nj w.r.t. A/2; update s r ; 

compare P"N 2 w.r.t. A/2; update s r \ 

evaluate s n = score due to noise (if any) in the locality of P\ 



normalize s in [0,100] scale; 
return s; 

[0045] Further, below is an exemplary algorithm to find a noise score of minutia P, 
corresponding to the noise about the minutia, according to one embodiment of the present 
invention: 



/* check the noise level in the a circular window centered at P and with radius 3 A/2 */ 
initialize: s n = 0; 

let win[i min .. imaxMjmin-Jmax] be a circular window 
s.t. [(x-i) 2 + (y-j) 2 f 2 < 3A/2, for all 

imi — ^ — I max 

andj min <j <j m ax\ 

let n r = number of ridgelines non-minutiae bifurcations and terminations 

(due to spurs, bridges, loops, islands, or, erratic ridge flow) 

present within the window win; 
let n v = number of valley line bifurcations and terminations 

present within the window win; 
if (n r + n v > n th res) 

for each ridge/valley bifurcation and termination win[^][^] 
find the distance (d k ) of win[^][^] from P; 

update s n accordingly depending on nearness of win[^][^] from P; 
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return s n ; 

[0046] Figure 5 is an exemplary gray-scale fingerprint image 500 to which embodiments of 
the invention for fingerprint minutiae matching using scoring techniques is applied for 
explanatory purposes. More particularly, Figure 5 shows an example of a gray-scale 
fingerprint image 500 of size 480x512 taken from the National Institute of Standards and 
Technology (NIST) special database 14. 

[0047] Although the claimed subject matter should not limited in scope by the following 
example, an embodiment of the invention is described hereinafter that has been applied to 
fingerprint images obtained from the Special Database- 14 of the National Institute of 
Standards and Technology (NIST), Gaithersburg, Md. 20899, USA. Utilizing embodiments 
of the invention for fingerprint matching using scoring techniques, the results in terms of 
processing time and quality of extraction have been found to provide advantages over 
alternative techniques. Likewise, this approach has been found to provide robust results in 
the presence of noisy images as well. For example, these techniques when applied to the 
noisy fingerprint image of Figure 5, produce very robust results for identifying valid minutiae 
based on the previously-described scoring techniques, as will be discussed hereinafter. 
[0048] Turning now to Figure 6, Figure 6 is an example of a fingerprint image 600 that has 
undergone pre-processing and that has had minutiae removed that do not belong to the classes 
of bifurcation or termination. Thus, after pixel classification followed by thinning and other 
pre-processing phases, e.g.., spur (isolated and ridge-connected) removal, detection of loops 
and bridges, and, removal of minutiae not belonging to the class of termination or bifurcation, 
a set of raw minutiae 610 remain, as shown in Figure 6. 

[0049] Next, this set of raw minutiae of Figure 6 is passed through the previously-described 
procedures of score assignment and approximately 50% of them are eliminated as their scores 
are estimated to be zero or close thereto. 

[0050] Looking to Figure 7, Figure 7 is a table illustrating coordinates (x,y), classifications 
(Bifurcation Minutiae (BM), Termination Minutiae (TM)), angles, and scores of the reduced 
set of minutiae that have survived the previously-described scoring process. As can be seen 
in the table of Figure 7, in this example, only surviving minutiae that have scores greater than 
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0 are kept. As can be seen in the table, only 36 minutiae survived the scoring process with 
scores greater than 0. 

[0051J ^ should be noted that in Figures 6, 8, 9, and 10 that the black lines represent 
ridgelines, whereas, gray lines (appearing dashed lines) correspond to the valley lines. For 
better visibility, the minutiae have been slightly enlarged in these figures. It should also be 
noted that the noisy regions in the skeletonized images have a higher density of bifurcations 
and terminations in the ridge and valley lines. 

[0052] With reference now to Figure 8, Figure 8 is an example of a fingerprint image 800 
that has undergone scoring, accordingly to embodiments of the invention as detailed in Figure 
7, and only minutiae 810 with a score greater than or equal to 1 remain and are shown in the 
fingerprint image 800. Visually it is quite evident that compared to the raw minutiae set, 
shown in Figure 6, this set of 36 minutiae 810 with scores greater than or equal to 1 have a 
higher level of confidence, for use in matching, as will be described in detail below. 
[0053] Further, with reference to Figures 9 and 10, Figure 9 is an example of a fingerprint 
image 900 that has undergone scoring, in which only 10 bifurcation minutiae and 5 
termination minutiae 910 with the highest scores are shown; whereas Figure 10 is an example 
of a fingerprint image 1000 that has undergone scoring, in which only 5 bifurcation minutiae 
and 2 termination minutiae 1110 with the highest scores are shown. 
[0054] Figures 9 and 10 illustrate fingerprint images that have undergone the previously- 
described scoring algorithm, and that include only the minutiae with the highest scores and 
these minutiae correspondingly have very high degrees of authenticity for use in matching, as 
will be described in detail below. 

[0055] It should be noted that the evaluation of scores can be made more thorough and 
extensive if more attributes are considered, such as follows: 

(i) Closeness in the values of ridge segments KjNj and K 2 N 2 (in Fig. 3 & Fig. 4). 

(ii) Closeness in the values of ridge segments KjMj and K 2 M 2 (in Fig. 3). 

(iii) Closeness in the values of valley segments L1V1 and L 2 V 2 (in Fig. 3). 

(iv) Closeness in the values of valley segments L } Ui and L 2 U 2 (in Fig. 3). 

(v) Jaggedness of the ridgelines r, r h r 2 , «/, n 2 , and valley lines v, vy, v 2 by 
sum of square of distance estimation of the corresponding line segments 
from their approximate curve fittings (e.g. splines). 

[0056] A matching procedure is provided as follows, according to one embodiment of the 
present invention. The set of minutiae with positive scores are sorted with respect to their 
scores in descending order. The set of minutiae {Pi | i= 1,2, ..,n; score(P,) > score(P /+ /) for i= 
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1 , 2,.., n-1 } are arranged in a heap-like structure such that the root (level 0) has Pj, the two 
nodes at level 1 have P 2 and Pj, the next level (level 2) nodes have P 4 , P5, Ps and P 7 > and so 
on. 

[0057] While looking for a match of the query set Y with a sample or pattern setX, a match is 
first attempted at the top level (higher score values) minutiae of Y with the top level minutiae 
of X. If there is a match between the two top-scoring minutiae subsets of X and Y y the heap 
structure is searched down further to check for full-set matching between X and Y. This 
procedure expedites the matching course of action and is able to deliver the result of 
approximate matching in terms of score. 

[0058] As previously discussed, in one embodiment, a two-dimensional PSPM matching 
algorithm to perform two-dimensional PSPM matching under translation and rotation is 
utilized to perform matching. 

[0059] Thus, embodiments of the invention related to fingerprint minutiae matching using 
scoring techniques, after a plurality of minutiae in a fingerprint image are initially defined, 
first implements the previously-described techniques to score each minutia in a fingerprint 
image. For example, the fingerprint image may be taken from a gray-scale fingerprint image. 
The score of each minutia is estimated and assigned to the minutia. The score of each 
minutia corresponds to the validity or authenticity of the minutia taking into account such 
things as ridge flow properties, valley flow properties, and noise. 
[0060] After this, many of the non-scoring or low scoring minutiae are removed from 
consideration. For example, pre-determined score criteria may be pre-defined. After scoring, 
the remaining higher scoring minutiae having a greater degree of validity may be utilized in a 
matching algorithm, such as, in one embodiment, a partial point set pattern matching (PSPM) 
algorithm. In this way, a scored query fingerprint image and one or more sample fingerprint 
images can be compared and matched using the PSPM algorithm in an accurate and efficient 
process. This PSPM algorithm will now be discussed in more detail. 

[0061] It should be noted that one of the basic problems associated with fingerprint matching 
is the following: given two objects A and 5, determine how much they resemble each other 
under different transformations. One method to solve this problem is by use of the partial 
point set pattern matching (PSPM) algorithm. 

[0062] The problem addressed by partial point set pattern matching can be stated as follows. 
To start, let A be the larger set of points (called sample set) and B, a small set of points 
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(called pattern or query set). The problem is to find whether B has a match in A, i.e. whether 
a subset of A exists which matches B. In one dimension, the problem is solved using the 
following procedure: the points are sorted with respect to their coordinates and a sequence of 
distances is found among the pair of consecutive members. The same thing is done for the 
pattern point set B also. Then, a string matching is performed to detect a match. Using this 
idea, Lee and Rezende (P. J. Rezende, and D. T. Lee, Point Set Pattern Matching in d- 
dimensions, Algorithmica, vol. 13, pp. 387-404, 1995 (hereinafter Lee and Rezende)) 
previously showed that given a set B of k points and a set A of n > k points in the d- 
dimensional Euclidian space, whether a k-subset of A matches B under translation, rotation 
and scaling can be found in 0(k.n d ) time. 0(k.n d ) is a conventional term in algorithms that 
represents the asymptotic upper bound in terms of k, n, d. 

[0063] Embodiments of the invention relate to a 2-D partial point set pattern matching 
problem under translation and rotation only. The PSPM algorithm set forth supports subset 
matching, that is, the number of points in a pattern set may be less than or equal to the 
number of points in the sample set. 

[0064] In actual applications related to fingerprint matching, there are a number of sample 
sets. The algorithm set forth pre-processes these sample sets such that, given an arbitrary 
pattern set, it tries to find the sample sets such that a subset of points in each of these sample 
sets match with the points in the given query pattern set, if they exist. 

[0065] An example of pre-processing is provided as follows. Suppose m sample sets, namely 
Si, £2, • . - , S m . Data structures for each set are prepared separately which will be used for 
matching with a query pattern set. Below the pre-processing of one set of points is described. 
[0066] Suppose that the set S\ has n points inside a rectangular box. Each point is arbitrarily 
labeled. The distances of all n C2 pairs of points are determined and stored in a height 
balanced binary search tree. This is referred to as the primary_structure. The nodes of this 
tree correspond to the distinct distances among the members in the point set. Each node is 
attached with a pointer to an array, called same_distance_ptr. The elements in the array 
correspond to all the pairs of points having distance equal to d. Each element of this array 
contains (i) identification of the pair of points contributing to this distance, and (ii) angle of 
the line joining these points with the x-axis. Apart from the primary structure, another data 
structure, called secondary_structure, is created for each element of 5,. It is an array of size 
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n-l, and its members correspond to the points in S\ \s sorted with respect to their distances 
from s. The primarystructure and the secondary_structure have been shown in Figure 12. 
[0067] For example the following algorithm may be used in order to effectuate this pre- 
processing: 

Operation PI : Label the points in $ as s\ 9 $2»- ■ s n , in an arbitrary manner. 
Operation P2: Process the members in 5/ one by one. 
Let ^ be the current point under processing. 

Compute dij = distance (s h Sj) and 0ij = angle of the line (s\, Sj) with the x-axis, for 

all j = i+1, ... jn. 

Create a new record with By, and the identifiers of the points s i9 sj. 
Find dy in the primary ^structure, 

If dij is already present, then insert the new record in the array attached to 

the node corresponding to dy, 

Otherwise, create a new node in the primary _structure corresponding to dy. 

Its attached array will contain the new record as a single element. 
Insert dy and its attached information in the secondary structure of both s x and s y 
Operation P3: Finally, sort the members of the secondary structure of each point with 
respect to the angle field. 

[0068] Further, query processing is also performed. For example, given a pattern point set P 
of size k 9 each sample set is considered separately. For each sample set S„ the objective is to 
find a subset of points that match with the points in P under translation and/or rotation. The 
exemplary query algorithm is performed as follows: 

Algorithm (* for matching Si with P *) 
Operation Ql : Label its points aspupi, ... , Ph 

Operation Q2: Next, pick up any two points (say with labels p\ and pi randomly from the 

pattern set, and compute distance 5 among them. 
Operation Q3 : Search the primary_structure with 5. 

If 5 is not present, then declare Si does not match with P; 
Otherwise, (* we need to perform a detailed study inside the sample set S{ *) 

Let the labels of the two end points of the matched distance in the 
primary ^structure of S\ be s\ and si. We anchor the line segment p\pi of P with 
the line segment s\si. 
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Search the secondary structure attached with s\ (s 2 ) to inspect whether there exists 
a match. For each point p x e P 

compute the distance d(pi s p/) and the angle Zpxpipi. 

Search the secondary structure of si {si) with d(pi s p/). 
If a match is found, the corresponding angle is also checked. 
If all the points in P are matched with k points of Sj, then 

report the name of the set i and the subset of the points of Sj, which 

matches, with the points in P. 

[0069] The above-described two-dimensional PSPM algorithm can be used to match a query 
fingerprint image against one or more sample fingerprint images. Particularly, both the query 
fingerprint image and the sample fingerprint images, will have both previously undergone the 
previously-described fingerprint minutia scoring techniques such that both the query 
fingerprint image and the sample fingerprint images involved in the matching process are 
utilizing reduced, high-scoring (and therefore with greater validity) query and sample 
minutiae sets. This results in an accurate and quickly converging PSPM matching algorithm. 
[0070] As previously discussed, many of the non-scoring or low scoring minutiae are 
removed from consideration from the query and sample fingerprint sets. For example, pre- 
determined score criteria may be pre-defined. After scoring, the remaining higher scoring 
minutiae having a greater degree of validity may be utilized in the PSPM matching algorithm 
such that the PSPM is very accurate and converges quickly. In this way, a scored query 
fingerprint image and one or more sample fingerprint images can be compared and matched 
using the PSPM algorithm in an accurate and efficient process. 

[0071] Particularly, the above-described PSPM matching algorithm in conjunction with the 
scoring techniques, according to embodiments of the present invention, was tested against a 
standard fingerprint image matching algorithm for the same problem presented by Lee and 
Rezende on a SUN Work Station, Ultra-Enterprise, Sparc, Sun4u (the OS version being 
Solaris 5.6). Figure 1 1 is a table illustrating the experimental performance of a standard 
matching algorithm utilizing reduced scored minutiae, versus the partial point set matching 
(PSPM) algorithm with scoring, on the problem presented by Lee and Rezende, according to 
embodiments of the present invention. 

[0072] In this test, a number of sample sets (K) were generated, and in each sample set S, 30 
to 40 points (which is approximately equal to the number of minutiae present in a typical 
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fingerprint) were generated. Thereafter, a particular point set S, was related at random; a 
subset from that point set was taken and arbitrarily translated and rotated to form the pattern 
set P. Then a sub-set matching was performed where each of the K sample sets were checked 
for a possible match. After a match was obtained, the algorithm was stopped. It should be 
noted that, as the pattern set P was a sub-set of a particular sample set from the K number of 
sample sets, a match is always ensured. This is also a sure test of the correctness of the 
algorithm. The time reported is averaged over a number of experiments for different values 
ofK. 

[0073] As shown, in Figure 11, compared with the standard matching algorithm, across a 
wide array of sample sets, the PSPM algorithm provided, on average, between approximately 
94-96% savings in CPU (i.e. central processing unit) time. 

[0074] It will, of course, be understood that, although particular embodiments have just been 
described, the claimed subject matter is not limited in scope to a particular embodiment or 
implementation. For example, one embodiment may be in hardware, whereas another 
embodiment may be in software. Likewise, an embodiment may be in firmware, or any 
combination of hardware, software, or firmware, for example. Likewise, although the 
claimed subject matter is not limited in scope in this respect, one embodiment may comprise 
an article, such as a storage medium. Such a storage medium, such as, for example, a CD- 
ROM, or a disk, may have stored thereon instructions, which when executed by a system, 
such as a computer system or platform, or a imaging system, for example, may result in an 
embodiment of a method in accordance with the claimed subject matter being executed, such 
as an embodiment of a method of fingerprint minutiae matching using scoring techniques, for 
example, as previously described. For example, an image processing platform or a 
fingerprint image processing system may include an integrated circuit, a processing unit, an 
input/output device and/or memory. 

[0075] Further, while embodiments of the present invention and its various functional 
components have been described in particular embodiments, it should be appreciated that the 
embodiments of the present invention can be implemented in hardware, software, firmware, 
middleware or a combination thereof and utilized in systems, subsystems, components, or 
sub-components thereof. 

[0076] When implemented in software or firmware, the elements of the present invention are 
the instructions/code segments to perform the necessary tasks. The program or code 
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segments can be stored in a machine readable medium (e.g. a processor readable medium or a 
computer program product), or transmitted by a computer data signal embodied in a carrier 
wave, or a signal modulated by a carrier, over a transmission medium or communication link. 
The machine-readable medium may include any medium that can store or transfer 
information in a form readable and executable by a machine (e.g. a processor, a computer, 
etc.). Examples of the machine-readable medium include an electronic circuit, a 
semiconductor memory device, a ROM, a flash memory, an erasable programmable ROM 
(EPROM), a floppy diskette, a compact disk CD-ROM, an optical disk, a hard disk, a fiber 
optic medium, a radio frequency (RF) link, etc. The computer data signal may include any 
signal that can propagate over a transmission medium such as electronic network channels, 
optical fibers, air, electromagnetic, RF links, bar codes, etc. The code segments may be 
downloaded via networks such as the Internet, Intranet, etc. 

[0077] Additionally, while embodiments of the invention have been described with reference 
to illustrative embodiments, these descriptions are not intended to be construed in a limiting 
sense. Various modifications of the illustrative embodiments, as well as other embodiments 
of the invention, which are apparent to persons skilled in the art to which embodiments of the 
invention pertain, are deemed to lie within the spirit and scope of the invention. 
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